Medical image processing apparatus, medical image processing method, program, and diagnosis support apparatus

ABSTRACT

Provided are a medical image processing apparatus, a medical image processing method, a program, and a diagnosis support apparatus that appropriately control whether or not to report reporting information of a medical image independently of a user operation. The above object is achieved by a medical image processing apparatus including a reporting control unit that performs control to bring reporting information included in a medical image into either a reporting state in which the reporting information is reported by a reporting unit or a non-reporting state in which the reporting information is not reported by the reporting unit. The reporting control unit brings the reporting information into the non-reporting state in a case where the medical image satisfies a non-reporting condition and brings the reporting information into the reporting state after a non-reporting time has elapsed from when the medical image does not satisfy the non-reporting condition.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a Continuation of PCT InternationalApplication No. PCT/JP2019/042158 filed on Oct. 28, 2019 claimingpriority under 35 U.S.C § 119(a) to Japanese Patent Application No.2018-206758 filed on Nov. 1, 2018. Each of the above applications ishereby expressly incorporated by reference, in its entirety, into thepresent application.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a medical image processing apparatus, amedical image processing method, a program, and a diagnosis supportapparatus, and specifically relates to a technique of controllingwhether or not to report reporting information of a medical image.

2. Description of the Related Art

A technique of automatically detecting a region of interest, such as alesion, from an endoscopic image is expected to contribute to preventingoversight of a lesion. The automatic detection technique is merelydirected to preventing oversight, and continuously reporting a detectionresult after a user has recognized the presence of a lesion hindersobservation and is thus not preferable. Thus, after the recognition bythe user, reporting information may be intentionally brought into anon-reporting state of not being reported.

However, the user may continue an examination while not recognizing thata non-reporting state has started. In this case, reporting informationis not reported to the user, and thus a lesion may be overlooked.

To address such an issue, JP4393016B discloses a technique of hiding amarker (corresponding to reporting information) for a candidate lesionshadow added to a computed tomography (CT) image in response to a clickon a hide icon, and regenerating a CT image with the original markerafter a predetermined time has elapsed. This technique makes it possibleto, after the marker has been hidden, prevent an examination from beingcontinued with the marker being kept hidden.

SUMMARY OF THE INVENTION

However, the technique described in JP4393016B is disadvantageous inthat a user is required to perform an operation to hide a marker.

The present invention has been made in view of these circumstances, andan object of the present invention is to provide a medical imageprocessing apparatus, a medical image processing method, a program, anda diagnosis support apparatus that appropriately control whether or notto report reporting information of a medical image independently of auser operation.

To achieve the above-described object, an aspect of a medical imageprocessing apparatus is a medical image processing apparatus including areporting control unit that performs control to bring reportinginformation included in a medical image into either a reporting state inwhich the reporting information is reported by a reporting unit or anon-reporting state in which the reporting information is not reportedby the reporting unit. The reporting control unit brings the reportinginformation into the non-reporting state in a case where the medicalimage satisfies a non-reporting condition and brings the reportinginformation into the reporting state after a non-reporting time haselapsed from when the medical image does not satisfy the non-reportingcondition.

According to this aspect, the reporting information is brought into thenon-reporting state in a case where the medical image satisfies thenon-reporting condition and is brought into the reporting state afterthe non-reporting time has elapsed from when the medical image does notsatisfy the non-reporting condition. Thus, the reporting information isbrought into the reporting state in a case where the non-reportingcondition is not satisfied, is brought into the non-reporting state in acase where the non-reporting condition is satisfied, is kept in thenon-reporting state from when the non-reporting condition is notsatisfied to when the non-reporting time elapses, and is brought intothe reporting state after the non-reporting time has elapsed. Thus, itis possible to appropriately control whether or not to report reportinginformation of a medical image independently of a user operation.

Preferably, the medical image processing apparatus includes an imageacquiring unit that sequentially acquires frame images of the medicalimage, a reporting information acquiring unit that acquires thereporting information from the medical image, a determining unit thatdetermines whether or not the medical image satisfies the non-reportingcondition, and a time measuring unit that measures a time elapsed fromwhen the medical image does not satisfy the non-reporting condition.Accordingly, it is possible to appropriately perform acquisition of themedical image, acquisition of the reporting information, determinationof the non-reporting condition, and determination of the elapsed time.

Preferably, the non-reporting condition is a condition of determining animage feature quantity of the medical image, and the medical imageprocessing apparatus includes an image feature quantity acquiring unitthat acquires the image feature quantity from the medical image.Accordingly, it is possible to stop reporting in accordance with theimage feature quantity.

Preferably, the image feature quantity includes at least one of aluminance of the medical image, color information of the medical image,a temporal change in the medical image, or frequency information of themedical image. Accordingly, it is possible to appropriately stopreporting.

Preferably, the non-reporting condition is a condition of determining atreatment state of a subject in the medical image, and the medical imageprocessing apparatus includes a treatment state estimating unit thatestimates the treatment state from the medical image. Accordingly, it ispossible to stop reporting in accordance with the treatment state.

Preferably, the medical image processing apparatus includes anon-reporting time setting unit that sets the non-reporting time inaccordance with the treatment state. Accordingly, it is possible toappropriately set the non-reporting time.

Preferably, the non-reporting condition is a condition of determining aregion-of-interest feature quantity, and the medical image processingapparatus includes a region-of-interest detecting unit that detects aregion of interest from the medical image, and a region-of-interestfeature quantity acquiring unit that acquires the region-of-interestfeature quantity from the region of interest. Accordingly, it ispossible to stop reporting in accordance with the region-of-interestfeature quantity.

Preferably, the region-of-interest feature quantity includes at leastone of an area of the region of interest, a position of the region ofinterest in the medical image, or a temporal change in the region ofinterest. Accordingly, it is possible to appropriately stop reporting.

Preferably, the reporting unit includes a sound output unit that outputsa sound, and the reporting control unit includes a sound control unitthat causes the sound output unit to output the sound. Accordingly, itis possible to appropriately report the reporting information.

Preferably, the reporting unit includes a first display unit, and thereporting control unit includes a display control unit that causes thefirst display unit to display the reporting information. Accordingly, itis possible to appropriately report the reporting information.

Preferably, the reporting unit includes a second display unit differentfrom the first display unit, and the display control unit causes thesecond display unit to display the reporting information. Accordingly,it is possible to appropriately report the reporting information.

Preferably, the display control unit changes, in accordance with thereporting state and the non-reporting state, a manner in which thesecond display unit displays the reporting information. Accordingly, itis possible to appropriately report the reporting information.

Preferably, the display control unit causes the second display unit todisplay the reporting information in a case of the non-reporting state.Accordingly, it is possible to appropriately observe the medical imagein the first display unit and to appropriately report the reportinginformation in the second display unit.

Preferably, the display control unit causes a third display unitdifferent from the first display unit to display information indicatingthe non-reporting state. Accordingly, a user can know that the reportinginformation is in the non-reporting state.

Preferably, the display control unit causes a fourth display unitdifferent from the first display unit to display information about atime elapsed from when the medical image does not satisfy thenon-reporting condition. Accordingly, a user can know the informationabout the elapsed time.

To achieve the above-described object, an aspect of a diagnosis supportapparatus is a diagnosis support apparatus including the above-describedmedical image processing apparatus and the first display unit. Accordingto this aspect, it is possible to appropriately control whether or notto display reporting information of a medical image independently of auser operation.

To achieve the above-described object, an aspect of a medical imageprocessing method is a medical image processing method including areporting control step of performing control to bring reportinginformation included in a medical image into either a reporting state inwhich the reporting information is reported by a reporting unit or anon-reporting state in which the reporting information is not reportedby the reporting unit. The reporting control step brings the reportinginformation into the non-reporting state in a case where the medicalimage satisfies a non-reporting condition and brings the reportinginformation into the reporting state after a non-reporting time haselapsed from when the medical image does not satisfy the non-reportingcondition.

According to this aspect, it is possible to appropriately controlwhether or not to report reporting information of a medical imageindependently of a user operation. A program for causing a computer toexecute the above-described medical image processing method is alsoincluded in this aspect.

According to the present invention, it is possible to appropriatelycontrol whether or not to report reporting information of a medicalimage independently of a user operation.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 a schematic diagram illustrating an overall configuration of anendoscope system including a medical image processing apparatus;

FIG. 2 is a block diagram illustrating an example of an electricconfiguration of the medical image processing apparatus;

FIG. 3 is a flowchart illustrating an example of individual steps in amedical image processing method;

FIG. 4 is a diagram illustrating transition of display on a display;

FIG. 5 is a diagram illustrating an example of display on the display ina reporting state;

FIG. 6 is a diagram illustrating an example of display on the display ina reporting state;

FIG. 7 is a diagram illustrating an example of display on the display ina reporting state;

FIG. 8 is a diagram illustrating an example of display on the display ina reporting state;

FIG. 9 is a diagram illustrating transition of display on the display;

FIG. 10 is a diagram illustrating transition of display on the display;

FIG. 11 is a diagram illustrating transition of display on the display;

FIG. 12 is a diagram illustrating transition of display on the display;

FIG. 13 is a block diagram illustrating an electric configuration of amedical image processing apparatus;

FIG. 14 is a diagram illustrating an example of transition of display ona first display and a second display;

FIG. 15 is a diagram illustrating another example of transition ofdisplay on the first display and the second display;

FIG. 16 is a diagram illustrating another example of transition ofdisplay on the first display and a third display;

FIG. 17 is a diagram illustrating another example of transition ofdisplay on the first display and a fourth display; and

FIG. 18 is a block diagram illustrating an example of an electricconfiguration of a medical image processing apparatus.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, preferred embodiments of the present invention will bedescribed in detail with reference to the attached drawings.

Overall Configuration of Endoscope System

FIG. 1 is a schematic diagram illustrating an overall configuration ofan endoscope system 9 including a medical image processing apparatusaccording to the present embodiment. As illustrated in FIG. 1, theendoscope system 9 includes an endoscope 10 which is an electronicendoscope, a light source apparatus 11, an endoscope processor apparatus12, a display apparatus 13, a medical image processing apparatus 14, anoperation unit 15, and a display 16.

The endoscope 10 is for capturing a time-series medical image and is,for example, a soft endoscope. The endoscope 10 has an insertion section20 that is to be inserted into a subject and that has a distal end and abase end, a handheld operation section 21 that communicates with thebase end side of the insertion section 20 and that is to be gripped by auser (medical doctor) to perform various operations, and a universalcord 22 that communicates with the handheld operation section 21.

The insertion section 20 has a small diameter and is elongated as awhole. The insertion section 20 is constituted by a soft part 25 havingflexibility, a bending part 26 that can be bent by operating thehandheld operation section 21, and a distal end part 27 includingtherein an imaging optical system (objective lens) that is notillustrated, an imaging device 28, and so forth, which are arranged inthis order from the base end side toward the distal end side andcommunicate with each other.

The imaging device 28 is a complementary metal-oxide semiconductor(CMOS) imaging device or a charge-coupled device (CCD) imaging device.On an imaging surface of the imaging device 28, image light of a portionto be observed is incident through an observation window that is open ina distal end surface of the distal end part 27 and that is notillustrated, and an objective lens that is disposed behind theobservation window and that is not illustrated. The imaging device 28captures the image light of the portion to be observed that has beenincident on the imaging surface (converts the image light into anelectric signal) and outputs an image signal.

The handheld operation section 21 is provided with various operationmembers that are to be operated by a user. Specifically, the handheldoperation section 21 is provided with two types of bending operationknobs 29 that are to be used in bending operations of the bending part26, an air/water supply button 30 for an air/water supply operation, anda suction button 31 for a suction operation. The handheld operationsection 21 is further provided with a still image capturing instructionunit 32 for providing an instruction to capture a still image 39 of aportion to be observed, and a treatment tool port 33 from which atreatment tool (not illustrated) is to be inserted into a treatment toolinsertion path (not illustrated) extending in and through the insertionsection 20.

The universal cord 22 is a connection cord for connecting the endoscope10 to the light source apparatus 11. The universal cord 22 includestherein a light guide 35, a signal cable 36, and a fluid tube (notillustrated) that extend in and through the insertion section 20. Inaddition, the universal cord 22 has an end portion provided with aconnector 37 a that is connected to the light source apparatus 11 and aconnector 37 b that branches off from the connector 37 a and that isconnected to the endoscope processor apparatus 12.

Connecting of the connector 37 a to the light source apparatus 11 causesthe light guide 35 and the fluid tube (not illustrated) to be insertedinto the light source apparatus 11. Accordingly, necessary illuminationlight, air, and water are supplied from the light source apparatus 11 tothe endoscope 10 through the light guide 35 and the fluid tube (notillustrated). As a result, the illumination light is radiated from anillumination window (not illustrated) on the distal end surface of thedistal end part 27 toward a portion to be observed. An operation ofpressing the above-described air/water supply button 30 causes air orwater to be ejected from an air/water supply nozzle (not illustrated) onthe distal end surface of the distal end part 27 toward the observationwindow (not illustrated) on the distal end surface.

Connecting of the connector 37 b to the endoscope processor apparatus 12causes the signal cable 36 and the endoscope processor apparatus 12 tobe electrically connected to each other. Accordingly, an image signal ofa portion to be observed is output from the imaging device 28 of theendoscope 10 to the endoscope processor apparatus 12, and a controlsignal is output from the endoscope processor apparatus 12 to theendoscope 10, through the signal cable 36.

The light source apparatus 11 supplies illumination light to the lightguide 35 of the endoscope 10 via the connector 37 a. As the illuminationlight, light in various wavelength ranges is selected in accordance withan observation purpose, for example, white light (light in a whitewavelength range or light in a plurality of wavelength ranges), light inone or a plurality of specific wavelength ranges, or a combinationthereof. A specific wavelength range is narrower than the whitewavelength range.

A first example of the specific wavelength range is, for example, a bluerange or green range in a visible range. The wavelength range in thefirst example includes a wavelength range of 390 nm or more and 450 nmor less or a wavelength range of 530 nm or more and 550 nm or less, andthe light in the first example has a peak wavelength in the wavelengthrange of 390 nm or more and 450 nm or less or the wavelength range of530 nm or more and 550 nm or less.

A second example of the specific wavelength range is, for example, a redrange in the visible range. The wavelength range in the second exampleincludes a wavelength range of 585 nm or more and 615 nm or less or awavelength range of 610 nm or more and 730 nm or less, and the light inthe second example has a peak wavelength in the wavelength range of 585nm or more and 615 nm or less or the wavelength range of 610 nm or moreand 730 nm or less.

A third example of the specific wavelength range includes a wavelengthrange in which a light absorption coefficient is different betweenoxyhemoglobin and deoxyhemoglobin, and the light in the third examplehas a peak wavelength in the wavelength range in which the lightabsorption coefficient is different between oxyhemoglobin anddeoxyhemoglobin. The wavelength range in the third example includes awavelength range of 400±10 nm, a wavelength range of 440±10 nm, awavelength range of 470±10 nm, or a wavelength range of 600 nm or moreand 750 nm or less, and the light in the third example has a peakwavelength in the wavelength range of 400±10 nm, the wavelength range of440 ±10 nm, the wavelength range of 470±10 nm, or the wavelength rangeof 600 nm or more and 750 nm or less.

A fourth example of the specific wavelength range is a wavelength range(390 nm to 470 nm) of excitation light that is to be used in observationof fluorescence generated by a fluorescent substance in a living body(fluorescence observation) and that excites the fluorescent substance.

A fifth example of the specific wavelength range is a wavelength rangeof infrared light. The wavelength range in the fifth example includes awavelength range of 790 nm or more and 820 nm or less or a wavelengthrange of 905 nm or more and 970 nm or less, and the light in the fifthexample has a peak wavelength in the wavelength range of 790 nm or moreand 820 nm or less or the wavelength range of 905 nm or more and 970 nmor less.

The endoscope processor apparatus 12 controls operations of theendoscope 10 via the connector 37 b and the signal cable 36. Theendoscope processor apparatus 12 generates a moving image 38, which is atime-series medical image made up of time-series frame images 38 a (seeFIG. 2) on the basis of image signals acquired from the imaging device28 of the endoscope 10 via the connector 37 b and the signal cable 36.The moving image 38 has a frame rate of, for example, 30 frames persecond (fps).

Furthermore, when the still image capturing instruction unit 32 isoperated in the handheld operation section 21 of the endoscope 10, theendoscope processor apparatus 12 acquires, while generating the movingimage 38, one frame image 38 a in the moving image 38 at the timing ofan image capturing instruction and regards the frame image 38 a as thestill image 39.

The moving image 38 and the still image 39 are each a medical imageacquired through imaging of the inside of a subject, that is, the insideof a living body. Furthermore, in a case where the moving image 38 andthe still image 39 are each an image acquired by using light in theabove-described specific wavelength range (special light), both theimages are special-light images. The endoscope processor apparatus 12outputs the generated moving image 38 and still image 39 to each of thedisplay apparatus 13 and the medical image processing apparatus 14.

The endoscope processor apparatus 12 may generate (acquire) aspecial-light image having information of the above-described specificwavelength range on the basis of a normal-light image acquired by usingthe above-described white light. In this case, the endoscope processorapparatus 12 functions as a special-light image acquiring unit. Theendoscope processor apparatus 12 acquires a signal in the specificwavelength range by performing computation based on RGB colorinformation of red, green, and blue or CMY color information of cyan,magenta, and yellow included in the normal-light image.

The endoscope processor apparatus 12 may generate a feature-quantityimage, such as a known oxygen saturation image, for example, on thebasis of at least one of a normal-light image acquired by using theabove-described white light or a special-light image acquired by usingthe above-described light in the specific wavelength range (speciallight). In this case, the endoscope processor apparatus 12 functions asa feature-quantity image generating unit. The moving image 38 or thestill image 39, including the above-described inside-of-living-bodyimage, normal-light image, special-light image, and feature-quantityimage, is a medical image generated through imaging of a result ofcapturing an image of a human body or measuring the human body for thepurpose of diagnosis or examination using the image.

The display apparatus 13 is connected to the endoscope processorapparatus 12 and displays the moving image 38 and the still image 39received from the endoscope processor apparatus 12. A user performs, forexample, an operation of moving the insertion section 20 forward orbackward while viewing the moving image 38 displayed on the displayapparatus 13. When the user finds a lesion or the like in a portion thatis being observed, the user operates the still image capturinginstruction unit 32 and captures a still image of the portion that isbeing observed, or performs diagnosis, biopsy, or the like.

The medical image processing apparatus 14 is an apparatus thatautomatically recognizes and automatically discriminates a lesion as aregion of interest, and reports reporting information included in amedical image to a user. As the medical image processing apparatus 14, apersonal computer is used, for example. As the operation unit 15, akeyboard, a mouse, and the like connected to the personal computer in awired or wireless manner are used. As the display 16 (an example of areporting unit), a monitor of various types, such as a liquid crystalmonitor, connectable to the personal computer is used.

The medical image processing apparatus 14 and the display 16 (an exampleof a first display unit) function as a diagnosis support apparatus thatdisplays the moving image 38 and reporting information on the display16.

First Embodiment Configuration of Medical Image Processing Apparatus

FIG. 2 is a block diagram illustrating an example of an electricconfiguration of the medical image processing apparatus 14 according toa first embodiment. The medical image processing apparatus 14illustrated in FIG. 2 is constituted mainly by a time-series imageacquiring unit 40, a region-of-interest detecting unit 42, a coordinatecalculating unit 44, an image information acquiring unit 46, anon-reporting time setting unit 54, a determining unit 56, a timemeasuring unit 58, a control unit 60, a display control unit 62, and astorage unit 64.

The control unit 60 centrally controls the time-series image acquiringunit 40, the region-of-interest detecting unit 42, the coordinatecalculating unit 44, the image information acquiring unit 46, thenon-reporting time setting unit 54, the determining unit 56, the timemeasuring unit 58, and the display control unit 62, and functions aspart of these units, on the basis of a program (medical image processingprogram) 68 stored in the storage unit 64.

The storage unit 64 is a storage device, such as a hard disk device. Thestorage unit 64 stores a detection result of the region-of-interestdetecting unit 42 and the still image 39 that has been captured, andalso stores the program 68 and information or the like related tovarious types of control of the medical image processing apparatus 14.

The storage unit 64 includes a figure storage unit 66. The figurestorage unit 66 stores a figure for reporting reporting information to auser.

The time-series image acquiring unit 40 sequentially acquires endoscopicimages as an example of medical images. Here, the time-series imageacquiring unit 40 acquires the moving image 38 (in this example, themoving image 38 captured by the endoscope 10) made up of the time-seriesframe images 38 a from the endoscope processor apparatus 12 by using animage input/output interface that is connected to the endoscopeprocessor apparatus 12 (see FIG. 1) in a wired or wireless manner andthat is not illustrated. In a case where the endoscope 10 captures theabove-described still image 39 while capturing the moving image 38, thetime-series image acquiring unit 40 acquires the moving image 38 and thestill image 39 from the endoscope processor apparatus 12.

The time-series image acquiring unit 40 may acquire the moving image 38via an information storage medium of various types, such as a memorycard or a hard disk device, instead of directly acquiring the movingimage 38 from the endoscope processor apparatus 12. Alternatively, thetime-series image acquiring unit 40 may acquire the moving image 38uploaded to a server, a database, or the like on the Internet, via theInternet.

The region-of-interest detecting unit 42 is an example of a reportinginformation acquiring unit that acquires, from a medical image,reporting information included in the medical image, and detects aregion of interest from the moving image 38 captured during observationof the inside of a subject. The region-of-interest detecting unit 42includes a convolutional neural network (CNN) that calculates a featurequantity of each of the frame images 38 a (or thinned out frame images38 a at regular intervals) of the moving image 38 and that recognizes aregion of interest in the image.

Examples of a region of interest include a polyp, a cancer, a colondiverticulum, an inflammation, a scar of endoscopic mucosal resection(EMR), a scar of endoscopic submucosal dissection (ESD), a clip portion,a bleeding point, a perforation, angiodysplasia, a treatment tool, andthe like.

The region-of-interest detecting unit 42 is capable of acquiring arecognition result of category classification or the like indicating acategory to which a detected region of interest belongs among aplurality of categories related to a lesion, such as “neoplastic”,“non-neoplastic”, and “others”.

The region-of-interest detecting unit 42 is not limited to a unit thatdetects a region of interest by using a CNN, and may be a unit thatdetects a region of interest by performing image processing to analyze afeature quantity, such as a color, pixel value gradient, shape, or sizein an image.

The coordinate calculating unit 44 is an example of a reportinginformation acquiring unit and calculates coordinate informationindicating a position in an image of a region of interest detected bythe region-of-interest detecting unit 42. The coordinate calculatingunit 44 calculates, for example, one or more pieces of coordinateinformation on the contour of a polygon or circle surrounding the regionof interest. The coordinate calculating unit 44 may calculate, ascoordinate information, the coordinates of the vertexes of a polygon orthe coordinates of midpoints of the sides of a polygon, or maycalculate, as coordinate information, the coordinates of points thatequally divide the circumference of a circle into a plurality ofsegments.

The image information acquiring unit 46 is an image processing unit thatacquires, from the moving image 38, image information for estimating thetiming at which reporting information is not necessary or the timing atwhich a detection result of the region-of-interest detecting unit 42 hasdecreased reliability. The image information acquiring unit 46 includesan image feature quantity acquiring unit 48, a treatment stateestimating unit 50, and a region-of-interest feature quantity acquiringunit 52.

The image feature quantity acquiring unit 48 acquires an image featurequantity, which is a feature quantity of each frame image 38 a of themoving image 38. The treatment state estimating unit 50 analyzes eachframe image 38 a of the moving image 38 through image processing andestimates a treatment state of a subject. The region-of-interest featurequantity acquiring unit 52 acquires a region-of-interest featurequantity, which is a feature quantity of a region of interest detectedby the region-of-interest detecting unit 42.

The non-reporting time setting unit 54 sets a non-reporting time, whichwill be described below. The non-reporting time is stored in, forexample, the storage unit 64. The non-reporting time setting unit 54reads out a non-reporting time from the storage unit 64 and sets theread out non-reporting time. The non-reporting time setting unit 54 mayset a non-reporting time in accordance with a treatment state estimatedby the treatment state estimating unit 50 or may set a value input by auser as a non-reporting time.

The determining unit 56 determines whether or not the moving image 38satisfies a non-reporting condition. The determining unit 56 maydetermine whether or not the moving image 38 satisfies the non-reportingcondition on the basis of image information acquired by the imageinformation acquiring unit 46. That is, the determining unit 56 maydetermine whether or not the moving image 38 satisfies the non-reportingcondition on the basis of at least one of an image feature quantityacquired by the image feature quantity acquiring unit 48, a treatmentstate estimated by the treatment state estimating unit 50, or aregion-of-interest feature quantity acquired by the region-of-interestfeature quantity acquiring unit 52.

The time measuring unit 58 measures a time elapsed from when the movingimage 38 does not satisfy the non-reporting condition. The timemeasuring unit 58 may count the number of frame images 38 a (the numberof frames) from when the moving image 38 does not satisfy thenon-reporting condition, thereby measuring the elapsed time.

The display control unit 62 controls display on the display 16. Thedisplay control unit 62 includes an image display control unit 62A and areporting information display control unit 62B. The image displaycontrol unit 62A outputs the moving image 38 acquired by the time-seriesimage acquiring unit 40 to the display 16 and causes the display 16 todisplay the moving image 38. That is, a plurality of frame images 38 aare sequentially displayed on the display 16.

The reporting information display control unit 62B is an example of areporting control unit that causes a reporting unit to report reportinginformation included in a medical image. The reporting informationdisplay control unit 62B performs control to bring reporting informationinto either a reporting state in which the reporting information isreported or a non-reporting state in which the reporting information isnot reported. The reporting information display control unit 62B causesthe display 16 to display, as reporting information, information about aregion of interest detected by the region-of-interest detecting unit 42in a reporting state. Here, the reporting information display controlunit 62B superimposes a figure read out from the figure storage unit 66on the position indicated by coordinate information calculated by thecoordinate calculating unit 44 of the frame image 38 a displayed on thedisplay 16. Accordingly, the figure is displayed in a superimposedmanner at the position of the region of interest of the moving image 38displayed on the display 16, and the region of interest is emphasized bythe figure.

The reporting information display control unit 62B brings reportinginformation into a non-reporting state in a case where the moving image38 satisfies the non-reporting condition. That is, in a case where themoving image 38 satisfies the non-reporting condition, the reportinginformation display control unit 62B brings a figure read out from thefigure storage unit 66 into a non-reporting state in which the figure isnot displayed, and stops reporting of reporting information by thedisplay 16.

Furthermore, the reporting information display control unit 62Bmaintains a non-reporting state from when the moving image 38 does notsatisfy the non-reporting condition to when a non-reporting time set bythe non-reporting time setting unit 54 elapses, and after thenon-reporting time has elapsed, starts a reporting state in which thereporting information is displayed. That is, the non-reporting time is atime during which a non-reporting state is maintained after thenon-reporting condition is not satisfied.

The reporting information display control unit 62B determines whether ornot the time elapsed from when the moving image 38 does not satisfy thenon-reporting condition exceeds the non-reporting time. If the timeelapsed from the non-satisfaction does not exceed the non-reportingtime, the reporting information display control unit 62B causes thereporting information to be kept in the non-reporting state.

If the time elapsed from the non-satisfaction exceeds the non-reportingtime, the reporting information display control unit 62B brings thereporting information into a reporting state. Here, the reportinginformation display control unit 62B superimposes a figure read out fromthe figure storage unit 66 on the position indicated by the coordinateinformation calculated by the coordinate calculating unit 44 in theframe image 38 a displayed on the display 16.

Assuming that the reverse of the non-reporting condition is a reportingcondition, it is possible to interpret that the reporting informationdisplay control unit 62B brings reporting information into a reportingstate in a case where the moving image 38 satisfies the reportingcondition and brings reporting information into a non-reporting state ina case where the moving image 38 does not satisfy the reportingcondition. In this case, the reporting information display control unit62B maintains a non-reporting state from when the moving image 38satisfies the reporting condition to when the non-reporting timeelapses. The reporting information display control unit 62B starts areporting state after the non-reporting time has elapsed from when themoving image 38 satisfies the reporting condition.

Medical Image Processing Method

Next, a medical image processing method using the medical imageprocessing apparatus 14 will be described. The medical image processingmethod is performed as a result of execution of the program 68 stored inthe storage unit 64 by the control unit 60.

In the present embodiment, reporting information indicates the positionof a region of interest, and the medical image processing apparatus 14displays a figure indicating the position of the region of interest onthe display 16. The reporting information may indicate the presence orabsence of a region of interest or may indicate a recognition result ofcategorization of a detected region of interest.

FIG. 3 is a flowchart illustrating an example of individual steps in themedical image processing method according to the first embodiment. Themedical image processing method includes an image acquisition step (stepS1), an image display step (step S2), a region-of-interest detectionstep (step S3), a determination step (step S5), a time measurement step(step S7), and a reporting control step (step S9 and step S10).

In step S1, the time-series image acquiring unit 40 acquires a frameimage 38 a of the moving image 38. In step S2, the image display controlunit 62A causes the display 16 to display the frame image 38 a acquiredin step S1.

In step S3, the region-of-interest detecting unit 42 detects a region ofinterest from the frame image 38 a acquired in step S1. In step S4, thecontrol unit 60 determines whether or not a region of interest has beendetected from the frame image 38 a as a result of step S3.

If it is determined in step S4 that a region of interest has not beendetected, the process of this flowchart ends. In this case, reportinginformation is absent and thus reporting information is not reported(not displayed). Thus, a figure indicating the position of a region ofinterest is not displayed on the display 16.

On the other hand, if it is determined in step S4 that a region ofinterest has been detected, the process proceeds to step S5. In step S5,the determining unit 56 determines whether or not the frame image 38 aacquired in step S1 satisfies a non-reporting condition.

If it is determined in step S5 that the frame image 38 a satisfies thenon-reporting condition, the process proceeds to step S9. In step S9,the reporting information display control unit 62B brings reportinginformation into a non-reporting state (hidden state), and ends theprocess of this flowchart. Thus, a figure indicating the position of theregion of interest is not displayed on the display 16.

On the other hand, if it is determined in step S5 that the frame image38 a does not satisfy the non-reporting condition, the process proceedsto step S6. In step S6, the determining unit 56 determines whether ornot a frame image 38 a preceding to the frame image 38 a acquired instep S1 satisfies the non-reporting condition.

If it is determined in step S6 that the preceding frame image 38 a doesnot satisfy the non-reporting condition, the process proceeds to stepS10. In step S10, the reporting information display control unit 62Bbrings the reporting information into a reporting state (display state),and ends the process of this flowchart. Thus, a figure is superimposedon the position of the region of interest in the frame image 38 adisplayed on the display 16.

If it is determined in step S6 that the preceding frame image 38 asatisfies the non-reporting condition, the process proceeds to step S7.In step S7, the time measuring unit 58 measures a time elapsed from whenthe moving image 38 does not satisfy the non-reporting condition.

In step S8, the reporting information display control unit 62Bdetermines whether or not the elapsed time measured by the timemeasuring unit 58 exceeds a non-reporting time. Here, a predeterminedtime is set as the non-reporting time by the non-reporting time settingunit 54.

A time longer than 0 is set as the non-reporting time. The non-reportingtime is, for example, a time of 0.5 seconds or more and 30 seconds orless. The non-reporting time is preferably a time of 1 second or moreand 7 seconds or less, and more preferably a time of 2 seconds or moreand 4 seconds or less.

If it is determined in step S8 that the elapsed time does not exceed thenon-reporting time, the process proceeds to step S9. In step S9, as inthe case of the shift from step S5, the reporting information displaycontrol unit 62B brings the reporting information into a non-reportingstate, and ends the process of this flowchart. Thus, a figure indicatingthe position of the region of interest is not displayed on the display16.

If it is determined in step S8 that the elapsed time exceeds thenon-reporting time, the process proceeds to step S10. In step S10, as inthe case of the shift from step S6, the reporting information displaycontrol unit 62B brings the reporting information into a reportingstate, and ends the process of this flowchart. Thus, a figure issuperimposed on the position of the region of interest in the frameimage 38 a displayed on the display 16.

As described above, with the medical image processing method accordingto the first embodiment, whether or not to report (display) reportinginformation of a medical image can be appropriately controlledindependently of a user operation.

In this flowchart, the region-of-interest detecting unit 42 performsregion-of-interest detection on the frame image 38 a both in a reportingstate and a non-reporting state. Alternatively, the region-of-interestdetecting unit 42 may perform region-of-interest detection only in areporting state.

FIG. 4 is a diagram illustrating transition of display on the display16. Part F4A illustrated in FIG. 4 illustrates display on the display 16at a certain time point. Part F4B illustrated in FIG. 4 illustratesdisplay on the display 16 after a certain time has elapsed from the timepoint in part F4A, and part F4C illustrated in FIG. 4 illustratesdisplay on the display 16 after a certain time has elapsed from the timepoint in part F4B. The frame images 38 a displayed on the display 16 inparts F4A, F4B, and F4C are frame images 38 a different from each otherof a single moving image 38 having a constant frame rate.

Part F4A illustrates a case where the frame image 38 a does not satisfya non-reporting condition and thus reporting information is in areporting state. In part F4A, a frame-shaped figure F1 surrounding aregion of interest R1 detected in the frame image 38 a is displayed onthe display 16 while being superimposed on the frame image 38 a. In thisway, reporting of the position of the region of interest makes itpossible to prevent a user from overlooking the region of interest.

Part F4B illustrates a case where the frame image 38 a satisfies thenon-reporting condition and thus reporting information is in anon-reporting state. In part F4B, the frame image 38 a including theregion of interest R1 is displayed on the display 16, but the figure F1is not displayed because the reporting information is hidden.

When the figure F1 is displayed on the display 16, observation of theframe image 38 a may be hindered depending on a situation. For example,after the user has found the region of interest R1, the figure F1 ismerely an obstacle to observation. Thus, in a case where thenon-reporting condition is satisfied, which may be the timing at whichthe reporting information is not necessary, the reporting information ishidden as illustrated in part F4B, and thus it becomes possible for theuser to easily observe the medical image.

Also in a case where the figure F1 is displayed as a result of wrongdetection by the region-of-interest detecting unit 42, observation ofthe frame image 38 a is hindered. Thus, also in a case where thenon-reporting condition is satisfied, which may be the timing at whichthe detection result of the region-of-interest detecting unit 42 hasdecreased reliability, the reporting information is hidden and thus itbecomes possible for the user to easily observe the medical image.

Also during a time from when the frame image 38 a does not satisfy thenon-reporting condition to when the non-reporting time elapses, thereporting information is kept in the non-reporting state and thus thefigure F1 is not displayed as in part F4B.

Part F4C illustrates a case where the reporting information has entereda reporting state again after the non-reporting time has elapsed fromwhen the frame image 38 a does not satisfy the non-reporting condition.As in part F4A, the frame-shaped figure F1 surrounding the region ofinterest R1 detected in the frame image 38 a is displayed on the display16 while being superimposed on the frame image 38 a.

If the reporting information is kept in a non-reporting state, thereporting information is not displayed even when screening of the regionof interest is restarted and the reporting information needs to bedisplayed, and the user may overlook the region of interest. Thus, thereporting information is brought into a reporting state in a case wherethe non-reporting condition is not satisfied. Accordingly, it ispossible to prevent a situation from occurring where the reportinginformation is not displayed continuously, without a user operation forrestarting display.

Here, if the reporting information is displayed immediately after thenon-reporting condition is not satisfied, the reporting information maybe repeatedly displayed and hidden at short intervals depending on imageinformation of the moving image 38, which may be inconvenient to theuser. Thus, a reporting state is started after the non-reporting timehas elapsed from when the non-reporting condition is not satisfied. As aresult of such transition from hiding to displaying, it is possible toprevent short-interval repetition of displaying and hiding.

Modification Examples of Display Manner of Reporting Region of Interest

The manner of reporting a region of interest on the display 16 is notlimited to the example of surrounding the region of interest with aframe-shaped figure.

FIG. 5 to FIG. 8 are diagrams each illustrating an example of display onthe display 16 in a reporting state, in which the frame image 38 aincluding the region of interest R1 is displayed.

In the case illustrated in FIG. 5, the reporting information displaycontrol unit 62B displays information IN1, which is the region ofinterest R1 that is filled in, thereby reporting the region of interestR1. The color with which the region of interest R1 is filled in is notlimited as long as a user can be notified. In this way, as a result offilling in the region of interest, it is possible to report the regionof interest such that the range of the region of interest can be easilyrecognized.

FIG. 6 and FIG. 7 each illustrate an example of reporting whether or nota region of interest has been detected regardless of the position of theregion of interest in an image.

In the case illustrated in FIG. 6, the reporting information displaycontrol unit 62B displays information IN2, which is a colored peripheryof the frame image 38 a, thereby reporting that the region of interestR1 has been detected. In this way, as a result of using a coloredperiphery of a medical image for reporting, it is possible to performreporting with a reduced movement of the line of sight of a user andwithout superimposing a figure that hinders observation on the medicalimage.

In the example illustrated in FIG. 7, the reporting information displaycontrol unit 62B displays information IN3, which is a star-shapedfigure, at an upper-right position outside the frame image 38 a, therebyreporting that the region of interest R1 has been detected. The shapeand position of the figure are not limited to those in this example. Inthis way, as a result of displaying a specific figure at a specificposition outside a medical image, it is possible to perform reportingwith a reduced movement of the line of sight of a user and withoutsuperimposing a figure that hinders observation on the medical image. Inaddition, such reporting has an influence on a small range in a displayscreen, which is advantageous in that reporting does not disturb theuser.

In the case illustrated in FIG. 8, the reporting information displaycontrol unit 62B displays information IN4, which is a colored region(here, the upper right) close to the region of interest in a peripheryof the frame image 38 a, thereby roughly reporting the position of theregion of interest R1. In this way, as a result of reporting a regionclose to the region of interest in the periphery of a medical image byusing a color, it is possible to perform reporting so that the positionof the detection target can be roughly grasped, without superimposing afigure that hinders observation on the medical image.

Display of Other Information

FIG. 9 is a diagram illustrating transition of display on the display16. Part F9A illustrated in FIG. 9 illustrates display on the display 16at a certain time point. Part F9B illustrated in FIG. 9 illustratesdisplay on the display 16 after 3 seconds have elapsed from the timepoint in part F9A. Part F9C illustrated in FIG. 9 illustrates display onthe display 16 after 2 seconds have elapsed from the time point in partF9B. The frame images 38 a displayed on the display 16 in parts F9A,F9B, and F9C are frame images 38 a different from each other in a singlemoving image 38 having a constant frame rate.

In parts F9A, F9B, and F9C, information IN5 indicating a reporting stateor a non-reporting state (an example of information indicating thatreporting information is in a non-reporting state), and information IN6indicating a remaining time during which reporting information is to bekept in a non-reporting state, that is, a difference between anon-reporting time and an elapsed time (an example of information abouta time elapsed from when a medical image does not satisfy thenon-reporting condition) are displayed in a display region (an exampleof a third display unit) different from a display region of the frameimage 38 a (an example of a first display unit) on the display 16.

Parts F9A and F9B each illustrate a case of a non-reporting state. Inparts F9A and F9B, the frame image 38 a including the region of interestR1 is displayed on the display 16, but the reporting information displaycontrol unit 62B does not report the region of interest R1.

In part F9A, the reporting information display control unit 62B displays“off” indicating that reporting information is in a non-reporting stateas the information IN5, and displays “5 sec” indicating that theremaining time is 5 seconds as the information IN6. In part F9B, thereporting information display control unit 62B displays “off” indicatingthat reporting information is in a non-reporting state as theinformation IN5, and displays “2 sec” indicating that the remaining timeis 2 seconds as the information IN6.

Part F9C illustrates a case where a reporting state has started afterthe non-reporting time has elapsed. In part F9C, the frame image 38 aincluding the region of interest R1 is displayed on the display 16, andthe reporting information display control unit 62B superimposes theframe-shaped figure F1 surrounding the region of interest R1 on theframe image 38 a. In part F9C, the reporting information display controlunit 62B displays “on” indicating that reporting information is in areporting state as the information IN5, and displays “0 sec” indicatingthat the non-reporting time has elapsed as the information IN6. Thereporting information display control unit 62B may hide the informationIN6 during a reporting state.

FIG. 10 and FIG. 11 are each a diagram illustrating transition ofdisplay on the display 16. The transition timings between parts F10A,F10B, and F10C illustrated in FIG. 10 and the transition timings betweenparts F11A, F11B, and F11C illustrated in FIG. 11 are similar to thetransition timings between parts F9A, F9B, and F9C illustrated in FIG.9, respectively. That is, the frame images 38 a displayed in parts F10A,F10B, and F10C and the frame images 38 a displayed in parts F11A, F11B,and F11C are similar to the frame images displayed in parts F9A, F9B,and F9C, respectively.

In parts F10A, F10B, and F10C, information IN5 indicating a reportingstate or a non-reporting state, and information IN7 indicating aremaining time during which reporting information is to be kept in anon-reporting state (an example of information about a time elapsed fromwhen a medical image does not satisfy the non-reporting condition) aredisplayed in a display region different from the display region of theframe image 38 a on the display 16.

The information IN7 represents the remaining time of a non-reportingstate by using a bar (progress bar) and is set such that the length of afilled-in portion of the bar is correlated with an elapsed time.

Parts F10A and F10B each illustrate a case of a non-reporting state. Inparts F10A and F10B, the frame image 38 a including the region ofinterest R1 is displayed on the display 16, but the reportinginformation display control unit 62B does not report the region ofinterest R1. In part F10A, the reporting information display controlunit 62B displays “off” indicating that reporting information is in anon-reporting state as the information IN5, and displays a bar whoseportion corresponding to a remaining time of 5 seconds is filed in asthe information IN7. In part F10B, the reporting information displaycontrol unit 62B displays “off” indicating that reporting information isin a non-reporting state as the information IN5, and displays a barwhose portion corresponding to a remaining time of 2 seconds is filed inas the information IN7.

Part F10C illustrates a case where a reporting state has started afterthe non-reporting time has elapsed. In part F10C, the frame image 38 aincluding the region of interest R1 is displayed on the display 16, andthe reporting information display control unit 62B superimposes theframe-shaped figure F1 surrounding the region of interest R1 on theframe image 38 a. In part F10C, the reporting information displaycontrol unit 62B displays “on” indicating that reporting information isin a reporting state as the information IN5, and displays a bar whoseportion corresponding to a remaining time of 0 seconds is filled in,that is, a bar that is not filled in, as the information IN7. Thereporting information display control unit 62B may hide the informationIN7 during a reporting state.

In this way, as a result of displaying a bar in which the length of afilled-in portion is correlated with an elapsed time, the user is ableto graphically interpret the remaining time.

In parts F11A, F11B, and F11C, information IN5 indicating a reportingstate or a non-reporting state, and information IN8 indicating aremaining time during which reporting information is to be kept in anon-reporting state (an example of information about a time elapsed fromwhen a medical image does not satisfy the non-reporting condition) aredisplayed in a display region different from the display region of theframe image 38 a on the display 16.

The information IN8 represents a remaining time by using colorinformation in part of a display region. The density of the colorincreases as the remaining time decreases.

Parts F11A and F11B each illustrate a case of a non-reporting state. Inparts F11A and F11B, the frame image 38 a including the region ofinterest R1 is displayed on the display 16, but the reportinginformation display control unit 62B does not report the region ofinterest R1. In part F11A, the reporting information display controlunit 62B displays “off” indicating that reporting information is in anon-reporting state as the information IN5, and displays a color with adensity corresponding to a remaining time of 5 seconds as theinformation IN8. In part F11B, the reporting information display controlunit 62B displays “off” indicating that reporting information is in anon-reporting state as the information IN5, and displays a color with adensity corresponding to a remaining time of 2 seconds as theinformation IN8.

Part F11C illustrates a case where a reporting state has started afterthe non-reporting time has elapsed. In part F11C, the frame image 38 aincluding the region of interest R1 is displayed on the display 16, andthe reporting information display control unit 62B superimposes theframe-shaped figure F1 surrounding the region of interest R1 on theframe image 38 a. In part F11C, the reporting information displaycontrol unit 62B displays “on” indicating that reporting information isin a reporting state as the information IN5, and displays a color with adensity corresponding to a remaining time of 0 seconds as theinformation IN8.

Here, the density of the color of the information IN8 in part F11B ishigher than the density of the color of the information IN8 in partF11A, and the density of the color of the information IN8 in part F11Cis higher than the density of the color of the information IN8 in partF11B. The density of the color may be increased as the remaining timedecreases.

In this way, as a result of representing a remaining time by using thedensity of the color of a periphery of a display region of a medicalimage, a user is able to grasp the remaining time without carefullyviewing a specific region, which is advantageous in that observation isnot hindered.

FIG. 12 is a diagram illustrating transition of display on the display16. Part F12A illustrated in FIG. 12 illustrates display on the display16 at a certain time point. Part F12B illustrated in FIG. 12 illustratesdisplay on the display 16 after a certain time has elapsed from the timepoint in part F12A. Part F12C illustrated in FIG. 12 illustrates displayon the display 16 after a certain time has elapsed from the time pointin part F12B. The frame images 38 a displayed on the display 16 in partsF12A, F12B, and F12C are frame images 38 a different from each other ina single moving image 38 having a constant frame rate.

In parts F12A, F12B, and F12C, information IN9 representing informationindicating a reporting state or a non-reporting state and informationindicating a remaining time during which reporting information is to bekept in a non-reporting state is displayed in a display region differentfrom the display region of the frame image 38 a on the display 16.

The information IN9 in which the characters “AI” are grayed outindicates a non-reporting state in which the non-reporting condition issatisfied. The information IN9 in which the characters “AI” are red witha certain density indicates a reporting state. Furthermore, in anon-reporting state from when the non-reporting condition is notsatisfied to when the non-reporting time elapses, the density of redcontinuously changes in accordance with a remaining time.

Part F12A illustrates a case of a non-reporting state in which thenon-reporting condition is satisfied. In part F12A, the frame image 38 aincluding the region of interest R1 is displayed on the display 16, butthe reporting information display control unit 62B does not report theregion of interest R1. The reporting information display control unit62B displays the grayed out characters of “AI” as the information IN9.This indicates that reporting of detection of a region of interest byartificial intelligence (AI) does not function.

Part F12B illustrates a case of a non-reporting state from when thenon-reporting condition is not satisfied to when the non-reporting timeelapses. In part F12B, the frame image 38 a including the region ofinterest R1 is displayed on the display 16, but the reportinginformation display control unit 62B does not report the region ofinterest R1. The reporting information display control unit 62B displaysthe red characters of “AI” having a density corresponding to a remainingtime as the information IN9.

Part F12C illustrates a case of a reporting state. In part F12C, theframe image 38 a including the region of interest R1 is displayed on thedisplay 16, and the reporting information display control unit 62Bsuperimposes the frame-shaped figure F1 surrounding the region ofinterest R1 on the frame image 38 a. The reporting information displaycontrol unit 62B displays the red characters of “AI” having a certaindensity corresponding to the reporting state as the information IN9.This indicates that reporting of detection of a region of interestfunctions.

Here, the density of red of the information IN9 in part F12C is higherthan the density of red of the information IN9 in part F12B. The colorof the information IN9 in a non-reporting state in which thenon-reporting condition is satisfied, and the color and density of theinformation IN9 in a reporting state are not limited to this example.

In this way, representing together information indicating a reportingstate or a non-reporting state and information indicating a remainingtime is advantageous in that screen display is simplified. In addition,a difference in the color of characters between a reporting state and anon-reporting state enables a user to easily identify the reportingstate and the non-reporting state. Furthermore, continuous change in thedensity of the color of the characters according to a remaining timeenables a user to grasp a remaining time. In the case of a non-reportingstate, the characters may be hidden instead of being grayed out. Theremaining time may be represented by light and shade of a figure, suchas an icon, instead of characters.

Details of Non-Reporting Condition Case of Determining Image FeatureQuantity

The non-reporting condition determined by the determining unit 56 is,for example, a condition of determining an image feature quantity of amedical image. The image feature quantity includes at least one of aluminance of the medical image, color information of the medical image,a temporal change in the medical image, or frequency information of themedical image.

For example, a time during which a user is observing a region ofinterest after finding the region of interest from the moving image 38may be a time during which reporting information is not necessary.Typically, during observation of the region of interest, a temporalchange in the moving image 38 is relatively small.

Thus, the image feature quantity acquiring unit 48 detects a temporalchange in the plurality of frame images 38 a of the moving image 38 asan image feature quantity. The determining unit 56 compares the detectedtemporal change with a temporal change set as a non-reporting condition.As a result, if it is determined that the detected temporal change issmaller, the reporting information display control unit 62B determinesthat the user is observing a region of interest after finding it andbrings the reporting information into a non-reporting state.

Also, a time during which the endoscope system 9 is supplying or suckingwater may be a time during which reporting information is not necessary.Typically, while water is being supplied or sucked, the amount of yellowcomponents and high-frequency components of the frame image 38 a islarge.

Thus, the image feature quantity acquiring unit 48 detects colorcomponents of the frame image 38 a as an image feature quantity. Thedetermining unit 56 compares detected yellow components with yellowcomponents set as a non-reporting condition. As a result, if it isdetermined that the amount of the detected yellow components is larger,the reporting information display control unit 62B determines that theendoscope system 9 is supplying or sucking water and brings thereporting information into a non-reporting state.

Likewise, the image feature quantity acquiring unit 48 detects frequencycomponents of the frame image 38 a as an image feature quantity. Thedetermining unit 56 compares detected high-frequency components withhigh-frequency components set as a non-reporting condition. As a result,if it is determined that the amount of the detected high-frequencycomponents is larger, the reporting information display control unit 62Bdetermines that the endoscope system 9 is supplying or sucking water andbrings the reporting information into a non-reporting state.

A case where the frame image 38 a has a too high or low luminance or acase where the frame image 38 a is extremely blurred may be a time atwhich a detection result of the region-of-interest detecting unit 42 hasdecreased reliability.

Thus, the image feature quantity acquiring unit 48 detects a luminanceof the frame image 38 a as an image feature quantity. The determiningunit 56 compares the detected luminance with a luminance range set as anon-reporting condition. As a result, if it is determined that thedetected luminance is not included in the set luminance range, thereporting information display control unit 62B determines that theaccuracy of a detection result of the region-of-interest detecting unit42 degrades and brings the reporting information into a non-reportingstate.

Likewise, the image feature quantity acquiring unit 48 detects a blur ofthe frame image 38 a as an image feature quantity. The determining unit56 compares the detected blur with a blur set as a non-reportingcondition. As a result, if it is determined that the detected blur islarger, the reporting information display control unit 62B determinesthat the accuracy of a detection result of the region-of-interestdetecting unit 42 degrades and brings the reporting information into anon-reporting state.

In this way, the non-reporting condition is set to the image featurequantity at the timing at which reporting information is not necessaryor the timing at which a region-of-interest detection result hasdecreased reliability, and the determining unit 56 compares the setimage feature quantity with an image feature quantity acquired by theimage feature quantity acquiring unit 48. Accordingly, the reportinginformation can be brought into a non-reporting state at an appropriatetiming.

In a case where the non-reporting condition of determining an imagefeature quantity is not satisfied, reporting information should notimmediately be brought into a reporting state. For example, in a casewhere a temporal change in the frame images 38 a is small, there isoften a situation in which a temporal change temporarily becomes largedue to a body movement and then the amount of temporal change quicklybecomes small. Such a timing at which a temporal change is temporarilylarge is not a timing at which screening restarts, and it is notnecessary to display reporting information. If displaying and hiding arerepeated at short intervals, the user may feel uncomfortable. Thus,after the non-reporting condition is not satisfied, the non-reportingstate is maintained until the non-reporting time elapses, and areporting state is started after the non-reporting time has elapsed.Accordingly, such a problem can be avoided.

Case of Determining Treatment State

The non-reporting condition may be a condition of determining atreatment state of a subject in a medical image. A time during which auser is giving treatment to a subject may be a time during whichreporting information is not necessary. The treatment state maycorrespond to a case where a treatment tool is seen in the frame image38 a, a case where bleeding is seen in the frame image 38 a, a casewhere the endoscope system 9 is set to an enlargement mode in whichimaging is performed with enlargement at a predetermined magnification,or the like.

For example, the treatment state estimating unit 50 detects a treatmenttool from the frame image 38 a. The determining unit 56 compares thedetected treatment tool with a treatment tool set as a non-reportingcondition, such as biopsy forceps or a snare. If it is determined thatthe detected treatment state satisfies the non-reporting condition, thereporting information display control unit 62B determines that a user isgiving treatment and brings the reporting information into anon-reporting state.

In a case where a treatment tool is detected from the frame image 38 a,it may be determined that the user is giving treatment and the reportinginformation may be brought into a non-reporting state regardless of thetype of the treatment tool. In this case, the determining unit 56 doesnot need to determine whether or not the non-reporting condition issatisfied, or may set all treatment tools as a non-reporting conditionto make a determination.

The treatment state estimating unit 50 detects a bleeding volume fromthe frame image 38 a. The determining unit 56 compares the detectedbleeding volume with a bleeding volume set as a non-reporting condition.If it is determined that the detected bleeding volume satisfies thenon-reporting condition, the reporting information display control unit62B determines that a user is giving treatment and brings the reportinginformation into a non-reporting state.

The treatment state estimating unit 50 detects a mode to which theendoscope system 9 is set. The determining unit 56 compares the detectedmode with the enlargement mode set as a non-reporting condition. If itis determined that the detected mode satisfies the non-reportingcondition, the reporting information display control unit 62B determinesthat a user is giving treatment and brings the reporting informationinto a non-reporting state.

The treatment state estimating unit 50 detects a coloring agent appliedinto a subject. The determining unit 56 compares the detected coloringagent with a coloring agent set as a non-reporting condition. If it isdetermined that the detected coloring agent satisfies the non-reportingcondition, the reporting information display control unit 62B determinesthat a user is making a diagnosis and brings the reporting informationinto a non-reporting state.

In a case where a coloring agent is detected, it may be determined thata user is giving treatment and the reporting information may be broughtinto a non-reporting state regardless of the type of the coloring agent.In this case, the determining unit 56 does not need to determine whetheror not the non-reporting condition is satisfied, or may set all coloringagents as the non-reporting condition to make a determination.

In this way, the non-reporting condition is set to the treatment stateat the timing at which reporting information is not necessary, and thedetermining unit 56 compares the set treatment state with a treatmentstate acquired by the treatment state estimating unit 50. Accordingly,the reporting information can be brought into a non-reporting state atan appropriate timing.

In a case where the non-reporting condition of determining a treatmentstate is not satisfied, display of reporting information should notimmediately be restarted. For example, in a case where biopsy forcepsare included in the frame image 38 a in a non-reporting state, there isoften a situation in which the forceps are covered with a mucousmembrane or residual liquid and are not seen temporarily, and then theforceps are seen again. Immediately restarting display at such a timingat which forceps are not seen temporarily is not preferable for a reasonsimilar to that in the case of determining an image feature quantity.Thus, after the non-reporting condition is not satisfied, thenon-reporting state is maintained until the non-reporting time elapses,and a reporting state is started after the non-reporting time haselapsed. Accordingly, such a problem can be avoided.

The non-reporting time may be changed in accordance with a treatmentstate. For example, in a case where biopsy forceps are included in theframe image 38 a, it can be determined, when the biopsy forceps are notseen at a forceps port any more, that biopsy treatment has finished.Thus, the non-reporting time setting unit 54 may set a relatively shorttime as the non-reporting time after the biopsy forceps are not seen atthe forceps port any more.

On the other hand, in the case of treatment such as endoscopic mucosalresection (EMR), a series of steps including a local injection,resection with a snare, and hemostasis with a clip are performed. Forexample, it is not possible to detect a treatment tool from the frameimage 38 a after the local injection until the snare is inserted throughthe forceps port. During this time, a treatment operation is beingperformed and thus reporting information should not be redisplayed.Thus, in response to detection of a local injection from the frame image38 a, the non-reporting time setting unit 54 sets a relatively long timeas the non-reporting time after the local injection is not detected anymore, and thus it is possible to avoid redisplay of reportinginformation during the series of operations.

Case of Determining Region-of-Interest Feature Quantity

The non-reporting condition may be a condition of determining aregion-of-interest feature quantity of a medical image. Theregion-of-interest feature quantity includes at least one of the area ofa region of interest, the position of the region of interest in amedical image, or a temporal change in the region of interest.

Typically, during observation of a region of interest, the ratio of thearea of the region of interest to the frame image 38 a is high, theposition of the region of interest is at a center portion of the frameimage 38 a, and a temporal change in the region of interest is small

Thus, the region-of-interest feature quantity acquiring unit 52 detects,as a region-of-interest feature quantity, the area of the region ofinterest in the frame image 38 a. The determining unit 56 compares thedetected area with an area set as a non-reporting condition. As aresult, if it is determined that the detected area is larger, thereporting information display control unit 62B determines that a user isobserving the region of interest after finding it and brings thereporting information into a non-reporting state.

The region-of-interest feature quantity acquiring unit 52 detects, as aregion-of-interest feature quantity, the position of the region ofinterest in the frame image 38 a. The determining unit 56 compares thedetected position with a position set as a non-reporting condition. As aresult, if it is determined that the detected position of the region ofinterest is closer to the center portion than the position set as thenon-reporting condition, the reporting information display control unit62B determines that a user is observing the region of interest afterfinding it and brings the reporting information into a non-reportingstate.

Likewise, the region-of-interest feature quantity acquiring unit 52detects, as a region-of-interest feature quantity, a temporal change inthe region of interest in the moving image 38. The determining unit 56compares the detected temporal change with a temporal change set as anon-reporting condition. As a result, if it is determined that thedetected temporal change is smaller, the reporting information displaycontrol unit 62B determines that a user is observing the region ofinterest after finding it and brings the reporting information into anon-reporting state.

In this way, the non-reporting condition is set to theregion-of-interest feature quantity at the timing at which reportinginformation is not necessary, and the determining unit 56 compares theset region-of-interest feature quantity with a region-of-interestfeature quantity acquired by the region-of-interest feature quantityacquiring unit 52. Accordingly, the reporting information can be broughtinto a non-reporting state at an appropriate timing.

As in the foregoing cases, in a case where the non-reporting conditionof determining a region-of-interest feature quantity is not satisfied,display of reporting information should not immediately be restarted.For example, there may be a case where a region of interest actuallyhaving a large area is temporarily and partially covered with residualliquid or the like and is determined to have a small area, a case wherea region of interest located at a center portion of the frame image 38 atemporarily moves to an edge portion of the frame image 38 a due to abody movement, or the like. Thus, after the non-reporting condition isnot satisfied, the non-reporting state is maintained until thenon-reporting time elapses, and a reporting state is started after thenon-reporting time has elapsed. Accordingly, such a problem can beavoided.

Second Embodiment Configuration of Medical Image Processing Apparatus

A description has been given above of an example in which the singledisplay 16 is connected to the medical image processing apparatus 14.Alternatively, the medical image processing apparatus 14 may beconnected to a plurality of display devices.

FIG. 13 is a block diagram illustrating an electric configuration of amedical image processing apparatus 14 according to a second embodiment.The medical image processing apparatus 14 is similar to the blockdiagram illustrated in FIG. 2. The display control unit 62 is connectedto a first display 16A, a second display 16B, a third display 16C, and afourth display 16D, and controls display on the individual displays.

The first display 16A, the second display 16B, the third display 16C,and the fourth display 16D are included in the endoscope system 9, forexample. The first display 16A, the second display 16B, the thirddisplay 16C, and the fourth display 16D are display devices, such asliquid crystal monitors, different from each other. Here, the displaycontrol unit 62 is connected to four display devices, but the number ofdisplay devices may be determined as necessary. The first display 16A,the second display 16B, the third display 16C, and the fourth display16D may be regions different from each other in a screen of a singledisplay device.

FIG. 14 is a diagram illustrating an example of transition of display onthe first display 16A and the second display 16B.

The reporting information display control unit 62B controls display onthe first display 16A (an example of a first display unit) similarly todisplay on the display 16 according to the first embodiment. In FIG. 14,parts F14A, F14B, and F14C illustrate display on the first display 16A,which are similar to parts F4A, F4B, and F4C illustrated in FIG. 4.

That is, parts F14A and F14C each illustrate a case where reportinginformation is in a reporting state. In parts F14A and F14C, theframe-shaped figure F1 surrounding the region of interest R1 detected inthe frame image 38 a is superimposed on the frame image 38 a. Part F14Billustrates a case where reporting information is in a non-reportingstate. In part F14B, the figure F1 is not displayed, but only the frameimage 38 a is displayed.

The reporting information display control unit 62B changes, inaccordance with a reporting state and a non-reporting state on the firstdisplay 16A, a manner in which the second display 16B (an example of asecond display unit) displays the reporting information. Here, thereporting information display control unit 62B displays reportinginformation on the second display 16B when the reporting information isin a non-reporting state.

In FIG. 14, parts F14D, F14E, and F14F illustrate display on the seconddisplay 16B at the same timings as parts F14A, F14B, and F14C,respectively. The frame images 38 a displayed in parts F14D, F14E, andF14F are the same as the frame images 38 a displayed in parts F14A,F14B, and F14C, respectively.

In parts F14D and F14F, corresponding to the timings at which thereporting information is in a reporting state, the figure F1 is notdisplayed. On the other hand, in part F14E, corresponding to the timingat which the reporting information is in a non-reporting state, theframe-shaped figure F1 surrounding the region of interest R1 issuperimposed on the frame image 38 a.

In this way, reporting information is displayed on the second display16B only when the reporting information is in a non-reporting state.Accordingly, in the first display 16A, it is possible to reduce aninfluence hindering observation by a user at the timing at which thereporting information is not necessary. In the second display 16B, theuser is able to check the reporting information when the user needs thereporting information.

Here, the frame images 38 a are displayed on the second display 16B.Alternatively, only the figure F1 as reporting information may bedisplayed on the second display 16B.

FIG. 15 is a diagram illustrating another example of transition ofdisplay on the first display 16A and the second display 16B. In thisexample, the reporting information display control unit 62B increases anemphasis level of reporting information to be displayed on the seconddisplay 16B when the reporting information is in a non-reporting state.Here, the emphasis level is how easily a user can recognize thereporting information. The user is able to recognize the reportinginformation more easily as the emphasis level increases.

In FIG. 15, parts F15A, F15B, and F15C illustrate display on the firstdisplay 16A, which are similar to parts F14A, F14B, and F14C illustratedin FIG. 14. In FIG. 15, parts F15D, F15E, and F15F illustrate display onthe second display 16B at the same timings as parts F15A, F15B, andF15C, respectively. The frame images 38 a displayed in parts F15D, F15E,and F15F are the same as the frame images 38 a displayed in parts F15A,F15B, and F15C, respectively.

In parts F15D and F15F, corresponding to the timings of a reportingstate, as in parts F15A and F15C, the frame-shaped figure F1 surroundingthe region of interest R1 detected in the frame image 38 a issuperimposed on the frame image 38 a. In part F15E, corresponding to thetiming of a non-reporting state, a frame-shaped figure F2 surroundingthe region of interest R1 detected in the frame image 38 a issuperimposed on the frame image 38 a. Here, the line of the figure F2 isthicker than the line of the figure F1. Thus, the emphasis level of thefigure F2 is higher than the emphasis level of the figure F1.

As a result of controlling display on the second display 16B in thismanner, a user is able to check reporting information more easily whenthe user needs the reporting information in a non-reporting state.

The reporting information display control unit 62B may cause the seconddisplay 16B to display the pieces of information IN1 to IN4 forreporting the region of interest illustrated in FIG. 5 to FIG. 8. Thereporting information display control unit 62B may cause the seconddisplay 16B to display the pieces of information IN1 to IN4 only whenthe reporting information is in a non-reporting state. In this case, theimage display control unit 62A may or may not display a medical image onthe second display 16B.

FIG. 16 is a diagram illustrating another example of transition ofdisplay on the first display 16A and the third display 16C. In thisexample, the reporting information display control unit 62B displaysinformation indicating that reporting information is in a non-reportingstate on the third display 16C (an example of a third display unit) whenthe reporting information is in a non-reporting state.

In FIG. 16, parts F16A, F16B, and F16C illustrate display on the firstdisplay 16A, which are similar to parts F14A, F14B, and F14C illustratedin FIG. 14. In FIG. 16, parts F16D, F16E, and F16F illustrate display onthe third display 16C at the same timings as parts F16A, F16B, and F16C,respectively.

The reporting information display control unit 62B causes the thirddisplay 16C to display nothing in parts F16D and F16F, corresponding tothe timings of a reporting state. The reporting information displaycontrol unit 62B causes the third display 16C to display informationIN10 indicating that reporting information is in a non-reporting statein part F16E, corresponding to the timing of a non-reporting state.

Here, characters are used as the information IN10. Alternatively, asymbol, a color, or the like may be used. In parts F16D and F16F,corresponding to the timings of a reporting state, the reportinginformation display control unit 62B may cause the third display 16C todisplay information indicating that reporting information is in areporting state.

As a result of controlling display on the third display 16C in thismanner, a user can recognize that reporting information is in anon-reporting state. In the non-report state, the user may perform anoperation by using the operation unit 15 to immediately bring the firstdisplay 16A into a reporting state.

FIG. 17 is a diagram illustrating another example of transition ofdisplay on the first display 16A and the fourth display 16D. In thisexample, the reporting information display control unit 62B causes thefourth display 16D (an example of a fourth display unit) to displayinformation about a time elapsed from when the non-reporting conditionis not satisfied.

In FIG. 17, parts F17A, F17B, and F17C illustrate display on the firstdisplay 16A, which are similar to parts F14A, F14B, and F14C illustratedin FIG. 14. Part F17B illustrates a case where reporting information iskept in a non-reporting state from when the frame image 38 a does notsatisfy the non-reporting condition to when the non-reporting timeelapses. In FIG. 17, parts F17D, F17E, and F17F illustrate display onthe fourth display 16D at the same timings as parts F17A, F17B, andF17C, respectively.

In parts F17D and F17F, corresponding to the timings at which thenon-reporting condition is not satisfied, the reporting informationdisplay control unit 62B causes the fourth display 16D to displaynothing. In part F17E, corresponding to the timing from when the frameimage 38 a does not satisfy the non-reporting condition to when thenon-reporting time elapses, the reporting information display controlunit 62B causes the fourth display 16D to display information IN11indicating a remaining time during which the reporting information is tobe in a non-reporting state, that is, indicating a difference betweenthe non-reporting time and the elapsed time.

Here, text information indicating a remaining time during which thereporting information is to be in a non-reporting state, and a figurethat indirectly represents the remaining time and in which the color ofthe region sequentially changes are displayed as the information IN11.Alternatively, a time elapsed from when the non-reporting condition isnot satisfied may be displayed. In addition, the reporting informationdisplay control unit 62B may cause the second display 16B to display thepieces of information IN6 to IN9 indicating the remaining timeillustrated in FIG. 9 to FIG. 12.

As a result of controlling display on the fourth display 16D in thismanner, a user can recognize information about a time elapsed from whenthe non-reporting condition is not satisfied. In a state where theinformation IN11 is displayed on the fourth display 16D, the user mayperform an operation by using the operation unit 15 to immediately bringthe first display 16A into a reporting state.

Third Embodiment Configuration of Medical Image Processing Apparatus

FIG. 18 is a block diagram illustrating an example of an electricconfiguration of a medical image processing apparatus 14 according to athird embodiment. The parts common to those in the block diagramillustrated in FIG. 2 are denoted by the same reference numerals, andthe detailed description thereof will be omitted.

The medical image processing apparatus 14 includes a sound control unit70. The sound control unit 70 is an example of a reporting control unitthat causes a reporting unit to report reporting information included ina medical image obtained through imaging of a subject. The sound controlunit 70 is connected to a sound output unit 17. The sound output unit 17functions as the reporting unit that reports reporting information andis included in the endoscope system 9 (see FIG. 1), for example. Thesound output unit 17 includes a member that outputs a sound, such as abuzzer or a speaker. The sound control unit 70 causes the sound outputunit 17 to output a sound in a reporting state to report reportinginformation. The sound to be output may be an alarm sound or a soundrelated to the reporting information.

Here, a description has been given of a configuration including thedisplay 16 and the sound output unit 17 as a reporting unit that reportsreporting information, but the configuration may include only the soundoutput unit 17. Alternatively, a lamp that emits light, a vibrator thatvibrates, or the like may be used as a reporting unit that reportsreporting information.

Others

The above-described medical image processing method can be configured asa program for causing a computer to implement individual steps, and itis possible to configure a non-transitory recording medium, such as acompact disc-read only memory (CD-ROM), storing the program.

In the embodiments described above, the endoscope processor apparatus 12and the medical image processing apparatus 14 have been described asapparatuses different from each other. Alternatively, the endoscopeprocessor apparatus 12 and the medical image processing apparatus 14 maybe integrated together as the endoscope processor apparatus 12 havingthe function of the medical image processing apparatus 14.

The hardware structure of a processing unit that executes variousprocesses of the endoscope processor apparatus 12 and the medical imageprocessing apparatus 14 includes various types of processors describedbelow. The various types of processors include a central processing unit(CPU), which is a general-purpose processor that executes software(program) and functions as various processing units; a graphicsprocessing unit (GPU), which is a processor specializing in imageprocessing; a programmable logic device (PLD), which is a processorwhose circuit configuration is changeable after manufacturing, such as afield programmable gate array (FPGA); a dedicated electric circuit,which is a processor having a circuit configuration designed exclusivelyfor executing specific processing, such as an application specificintegrated circuit (ASIC), and the like.

A single processing unit may be constituted by one of these varioustypes of processors or may be constituted by two or more processors ofthe same type or different types (for example, a combination of aplurality of FPGAs, a combination of a CPU and an FPGA, or a combinationof a CPU and a GPU). A plurality of processing units may be constitutedby a single processor. Examples of constituting a plurality ofprocessing units by a single processor are as follows. First, asrepresented by a computer of a client or server, a single processor isconstituted by a combination of one or more CPUs and software, and theprocessor functions as a plurality of processing units. Secondly, asrepresented by a system on chip (SoC), a processor in which a singleintegrated circuit (IC) chip implements the function of an entire systemincluding a plurality of processing units is used. In this way, varioustypes of processing units are constituted by using one or more of theabove-described various types of processors as a hardware structure.

Furthermore, the hardware structure of these various types of processorsis, more specifically, electric circuitry including a combination ofcircuit elements, such as semiconductor elements.

The technical scope of the present invention is not limited to the scopedescribed in the above embodiments. The components in the individualembodiments can be appropriately combined between embodiments withoutdeviating from the gist of the present invention.

REFERENCE SIGNS LIST

9 endoscope system

10 endoscope

11 light source apparatus

12 endoscope processor apparatus

13 display apparatus

14 medical image processing apparatus

15 operation unit

16 display

16A first display

16B second display

16C third display

16D fourth display

17 sound output unit

20 insertion section

21 handheld operation section

22 universal cord

25 soft part

26 bending part

27 distal end part

28 imaging device

29 bending operation knob

30 air/water supply button

31 suction button

32 still image capturing instruction unit

33 treatment tool port

35 light guide

36 signal cable

37 a connector

37 b connector

38 moving image

38 a frame image

39 still image

40 time-series image acquiring unit

42 region-of-interest detecting unit

44 coordinate calculating unit

46 image information acquiring unit

48 image feature quantity acquiring unit

50 treatment state estimating unit

52 region-of-interest feature quantity acquiring unit

54 non-reporting time setting unit

56 determining unit

58 time measuring unit

60 control unit

62 display control unit

62A image display control unit

62B reporting information display control unit

64 storage unit

66 figure storage unit

68 program

70 sound control unit

F1, F2 figure

IN1 to IN11 information

R1 region of interest

S1 to S10 individual steps of medical image processing method

What is claimed is:
 1. A medical image processing apparatus comprising:a reporting control unit that performs control to bring reportinginformation included in a medical image into either a reporting state inwhich the reporting information is reported by a reporting unit or anon-reporting state in which the reporting information is not reportedby the reporting unit, wherein the reporting control unit brings thereporting information into the non-reporting state in a case where themedical image satisfies a non-reporting condition and brings thereporting information into the reporting state after a non-reportingtime has elapsed from when the medical image does not satisfy thenon-reporting condition.
 2. The medical image processing apparatusaccording to claim 1, comprising: an image acquiring unit thatsequentially acquires frame images of the medical image; a reportinginformation acquiring unit that acquires the reporting information fromthe medical image; a determining unit that determines whether or not themedical image satisfies the non-reporting condition; and a timemeasuring unit that measures a time elapsed from when the medical imagedoes not satisfy the non-reporting condition.
 3. The medical imageprocessing apparatus according to claim 1, wherein the non-reportingcondition is a condition of determining an image feature quantity of themedical image, the medical image processing apparatus comprising animage feature quantity acquiring unit that acquires the image featurequantity from the medical image.
 4. The medical image processingapparatus according to claim 3, wherein the image feature quantityincludes at least one of a luminance of the medical image, colorinformation of the medical image, a temporal change in the medicalimage, or frequency information of the medical image.
 5. The medicalimage processing apparatus according to claim 1, wherein thenon-reporting condition is a condition of determining a treatment stateof a subject in the medical image, the medical image processingapparatus comprising a treatment state estimating unit that estimatesthe treatment state from the medical image.
 6. The medical imageprocessing apparatus according to claim 5, comprising a non-reportingtime setting unit that sets the non-reporting time in accordance withthe treatment state.
 7. The medical image processing apparatus accordingto claim 1, wherein the non-reporting condition is a condition ofdetermining a region-of-interest feature quantity, the medical imageprocessing apparatus comprising: a region-of-interest detecting unitthat detects a region of interest from the medical image; and aregion-of-interest feature quantity acquiring unit that acquires theregion-of-interest feature quantity from the region of interest.
 8. Themedical image processing apparatus according to claim 7, wherein theregion-of-interest feature quantity includes at least one of an area ofthe region of interest, a position of the region of interest in themedical image, or a temporal change in the region of interest.
 9. Themedical image processing apparatus according to claim 1, wherein thereporting unit includes a sound output unit that outputs a sound, andthe reporting control unit includes a sound control unit that causes thesound output unit to output the sound.
 10. The medical image processingapparatus according to claim 1, wherein the reporting unit includes afirst display unit, and the reporting control unit includes a displaycontrol unit that causes the first display unit to display the reportinginformation.
 11. The medical image processing apparatus according toclaim 10, wherein the reporting unit includes a second display unitdifferent from the first display unit, and the display control unitcauses the second display unit to display the reporting information. 12.The medical image processing apparatus according to claim 11, whereinthe display control unit changes, in accordance with the reporting stateand the non-reporting state, a manner in which the second display unitdisplays the reporting information.
 13. The medical image processingapparatus according to claim 12, wherein the display control unit causesthe second display unit to display the reporting information in a caseof the non-reporting state.
 14. The medical image processing apparatusaccording to claim 10, wherein the display control unit causes a thirddisplay unit different from the first display unit to displayinformation indicating the non-reporting state.
 15. The medical imageprocessing apparatus according to claim 10, wherein the display controlunit causes a fourth display unit different from the first display unitto display information about a time elapsed from when the medical imagedoes not satisfy the non-reporting condition.
 16. A diagnosis supportapparatus comprising: the medical image processing apparatus accordingto claim 10; and the first display unit.
 17. A medical image processingmethod comprising: a reporting control step of performing control tobring reporting information included in a medical image into either areporting state in which the reporting information is reported by areporting unit or a non-reporting state in which the reportinginformation is not reported by the reporting unit, wherein the reportingcontrol step brings the reporting information into the non-reportingstate in a case where the medical image satisfies a non-reportingcondition and brings the reporting information into the reporting stateafter a non-reporting time has elapsed from when the medical image doesnot satisfy the non-reporting condition.
 18. A non-transitorycomputer-readable recording medium storing instructions that, when readby a computer, cause the computer to execute the medical imageprocessing method according to claim 17.